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ABSTBACT 

The University of Hinnesota <s Special Education 
Adaiiristratlon Training Prograi (SEATP) is a coapetency^based 
education prograa, developed froi a systeas orientation nodel, and 
used for continuing education of professional administrators. The 
report presents an overview of the SEATP prograa under the following^ 
topical areas: (1) background inforaation, including a brief 
discussion of the position of special education directors, their 
educational needs (primarily those needs\docuaented in Hinnesota) , 
and the concept of cospetency-based training; (2> a description of 
SEATP in operation, including salient features of the program and the 
sequence of activities nhich the participating director of special 

t education vould coiplete; (3) presentation of a general aodel for 
— d^elopsent of this or siiilar preservice or continuing education 

• programs, a discussion of the purpose, and applications of each 

coapcnent, and examples of procedures^, aeasureaent, tools, .etc. froa 
SEATP to resolve those issues; (4) discussion of coapetency-^based 

. education issues as they concern the' Special Education Adainistration 
Training Prograa. (HH) 
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_ INTRODU^CT^ „ , 

In September, 1973, the University of Minnesota began operating a 
new training . program for special education administrators • Known as the 
Special Education Administration Training Program (SEATP) , the project 
is a joint venture between two departments of the University: Departments 
of Special Education and Educational Administration. It is supported by 
a grant from the Bureau of Education for the Handicapped, U.S. Office of 
Education, and by funds from the University of Minnesota. 

The program is designed simultaneously to meet a current, pressing ^ 
need in Minnesota and also to serve as a model that can be replicated 
in training administrators and practitioners in other areas of human services 
(^•g»» practitioners and administrators of day activity centers, group homes, 
nursing homes, etc.). In addition, the general model of this program may 
be applied to preparation programs for other types of positions. 
I SEATP is a (1) competency-based education program, (2) developed 
from a systems orientation model, and (3) used for continuing education 
of professional administrators. Each of these three features was adopted 
to promote educational effectiveness and efficiency. 

A competency-based (or performance-based) preparation program is 
one in which 

...performance goals are specified, and agreed to, in rigorous 
detail in advance of instruction. The student must either be 
able to demonstrate his abilities or perform job tasks* He is 
held accountable, not for passing grades, but for attaining a 
given level of competency. . .the training Institution is itself 
held accountable for producing able practitioners. Emphasis is 
on demonstrated produce or output. 

(Elam, 1971, pp. 1-2) 
SEATP^s adoption of a competency-based approach is an attempt to focus . 
on education directly applicable to the special education administrator *s 
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actufl Job. As a consequence, the program (SEATP) should be better able 
to accommodate individual educational needs. In addition, the procedures 
developed to identify and validate competencies should promote prompt 
changes in the existing curriculum sequence to meet changing conditions 
and to facilitate replication of the model elsewhere. 

The requirement that compatency-based programs be able to demon- 
strate the proficiency of each trainee implies that they are data-based. 
SEATP has used a systems approach to identify each component of the 
training development sequence and to attempt to assure sufficient infor- 
mation for making decisions at each point. The systems orientation should 
also contribute substantially to ease of program modification and repli- 
cation. ^^^^^.-^ 

S^TP is a continuing education program which can be pursued by the 
employed director of special education while he is on the job. It has . 
incorporated procedures used successfully in other continuing education 
programs (including tliose currently being utilized by the Continuing 
Education Program in Hospital and Health Care Administration, School 
of Public Health, University of Minnesota, and the American Management 
Association Continuing Education Program) . Continuing education has the 
advantage of enabling more directors of special education to participate 
than would be possible with traditional on-campus training programs • ^ It 
is also expected to be more efficient, both in terms of time and in 
cost, especially after the initial program development phase has been 
completed.' However, the program can readily be offered 'on either a pre- 
service or inservice basis, because of the nature of the competencies 

toward which the program is directed (minimum essential on-the-job per- 

i 

f ormances) • 
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Purpose of this paper 

A 

This report attempts to present an overview of the SEATP program, 
under the following topical areas: 

(1) Contextual or background information about the program. This 
will include a brief discussion of the position of special 

education directors, their educational needs' (primarily those 

• needs documented in Minnesota) and the concept of competency- 

based training which was briefly mentioned in the preceeding 

paragraphs* 

(2) A description of SEATP in operation, including salient features 
of the program and the sequence of a<;tivities which the par- 
ticipating director of special education would complete. 

(3) Presentation of a general model for development of this or 
similar preservice or continuing education programs. The 
purpose and applications of each component wiir be discussed, 
and examples of procedures, measurement tools » etc* from SEATP 
to resolve those issues. 

(4) Discussion of competency-based education issues as they con- 
cern the Special Education Administration Training Program. 

BACKGROUND 

The "administrator of special education" position 

Special education programs and services for handicapped children 
have expanded during the last decade at an unprecedented rate* This 
sharp acceleration in services is due to a ntunber of factors, including 
philosophical acceptance of the right of all children to an education, 
advocacy from parents of exceptional children- as well as school personnel 
for special services, litigation and legislation requiring public schools 

to provide special services, and increased state and federal funding for 

/ 
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initiation and ongoing support of such programs. 

This increase in the number of services appea rs to be marching along 
with expanding sophistication in the field. Research and demonstration 
programs have provided insights into the manner in which exceptional 
children learn* Correspondingly appropriate instructional technology are 
developed to cope with the problems. Many studies have also recommended 
new conceptualizations of service models and organization patterns to 
facilitate pupil learning and efficient use, of resources. The impact 
of these new ways of looking at the problem is undoubtedly manifested 
in several programs we have today. 

One of the most promj.nent of these trends is the philosophy referred 
to in its various guises as "mains t:-. earning", "normalization" or "the 
principle of least restrictive alternatives". It Implies that the 
traditional methods of providing special education services need to be 
thoroughly reexamined. Meisgeier and King (1970), for example, comment 
that: 

The main alternative to a regular class has been placement in 
a special self-contained class. However, new sequential arrange- 
ments of instructional alternatives suggest that only a small 
number of exceptional children will require self-contained settings. 
The greatest number may be able to remain in the profit from the 
main system if resource help is available and if that system 
makes use of concepts such as differentiated staffing and provides 
viable mechanisms for the individualization of instruction, (p. ix) 

As the schools* capability to accommodate handicapped children in 

regular education programs increases, the organization of special education 

services must change accordingly. 

In th4 past, general education focused on the "modal" or large 
group of typical children within the school population; special 
educdlrion was delegated the responsibility for educating those 
children who fell into disability categories defined by general 
educators as being children unsuited for the general educational 
program. But events in recent years indicate that these two 
quasi-distlact educat'ional systems- will converge, and the next 
decade may see all. children and teachers within the parameters 
of education. (Weatherman, 1968, p. 17) 



However, as these-^hanges take place, a parallel trend has been 
establishment of separate administrative units for special education 
programs. The numbers of directors and other administrators of special 
education programs have been growing rapidly. A number of reasons account 
for this trend and these can best be examined within the content of the 
following broad rationale: 

Purpose of special education . A general purpose -for which special 
education is organized is to provide interventions designed to remedy or 
ameliorate those conditions which thwart normal development. The respon- 
sible organizational unit must Include not only special te^.^hers, materials 
etc., Jbut also provisions for effective advocacy of exceptional children s 

, > 

rights and needs, expertise to plan and supervise special education inter-* 
ventions, and to ensure ongoing communications with all levels withinythe 
school system and with appropriate community agencies* 

Population to be served . * Although many mildly handicapped children 
can be served in mainstream programs with appropriate support, schools are 
also being asked to provide intensive services for severely and multiply 
impaired children who were previously considered "uneducable", and who 
require intensive, expensive services. These services are often provided 
in conjunction with non-school agencies, in cooperation with other school 
districts, or by Intermediate districts, rather than by the district in 
which the child resides, but the local school district retains respon- 
sibilities for program monitoring and tuition payments* 

Categorical legislation and funding sources * Most states provide 
categorical state funding for special education services and increased 
federal support for special education has become available* These factors 

- 8 / 



have created needs for efficient planning, supervision, and accountability 
for these multiple funding sources. 

Consequently, program development, organisation, and supervision 

— involver^^many complex responsibilities for the director of special education. 

• He/she is expected to~be a specialist in a variety of functions — develop- 
ment of learning systems for the handicapped, administrative procedures, 
communications with many agencies and persons concerned with the handi- 
capped, curriculum development, and contributions to the advancement of 
general education. A broad classification of these functions might be 
listed as follows: 

1. ^ Devising ways of identifying children with special, needs. 

2. Assessing children with special needs in order to determine / 
what kinds of special programs and services should be provided. 

3. Planning the appropriate variety of interventions or program 
alternatives to n^diate properly between the child *s special 
education needs and tasks of rehabilitation and/or educational 
development* \ 

4. Marshalling and organizing the resources needed in a compre- 
hensive program of special education for exceptional children. 

5. Directing, coordinating, and counseling appropriately in guiding 
the efforts of those engaged in the special e<^ucation enterprise . 

6. Evaluating and conducting research in order to improve special 
instruction and the quality of special services* 

'4' 

7. Xntitrpreting and reporting information to gain public support 
and influence the power structure in helping to achieve program 
objectives. 

8. Recruitment, selection and training of competent.staf f • 

(Weatherman, 1968, p. 11) 

Indicators of training needs 

In the past, little emphasis has been placed by colleges and univer- 
sities on education of special education administrators or on research 
training these leadership personnel. ^ 
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Milazzo and Blessing reported in 1964 that of 225 colleges and univer- 
sities preparing special education personnel, only 40 offered programs in 
administration and supervision* Only eight programs offered a sequence of 
general administration courses, and Milazzo and Blessing reported a need 
for specific training and experience in administrative endeavors. Willenberg 
C1966) noted the "paucity of specific research on administration of special 
education" (p. 134) and described several obstacles which might account 
for this lack. Connor (1970) noted "an intermittent and slow rate of 
interest in specifying and upgrading standards of preparation" (p, 373). 



More recently, Vance and Howe (1974), in a fqllowup study of students 

\ 

who had received federal training gran 
administrator training was provided at 



:s, noted that most special "^education 
^he doctoral level, and stated: 



This is expensive, time consuming,/ and igndres the need for training 
at the subdoctoral level for those individuals- just beginning a 
career at the management level in special education, (p. 121) 

Vance and Howe also indicated needs for competence in general administrative 
processes and practices as a result of tHe mainstreaming movement, akifl^ 
in understanding the implications of due process, and internship oppor- 
' tunities . 

In considering development of preparation programs for these directors, 
however, a further need becomes apparent: the lack of precise definition 
\ of the curriculum due to the frequent ambiquity or the special education 

administrator's role. 

Unlike the role of a school principal or business agent for a school 
district, the role of the special education administrator has been deter- 
mined by factors such as state laws and regulations, educatlonair^actices 
in the national, state, regional, or local programs for which he is respon- 
sible, and the philosophy toward handicapped children which exists in his 

s 

organizational unit. A recent discussion (Kohl and Karrp, 1971) commented: 
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It is difficult to define the typical duties of this leader since 
he is found in different administrative patterns and has a variety 
of titles with little relationship to specific functions, (p. 9) 

In addition to variations in Job descriptions among directors, 

further ambiguity is created by the differing ways In which other staff in 

•4 * * 

the school district and community perceive the director's role, creating dis- 
crepant expectationSo of the administrator of special education (llensley, 1973) • 

Dsspite these variatloits in role definition, however, some studies 
have noted a convergence on typical or most pressing problems encountered ^ 
by special education directors in Minn^esota, as preceived by the directors 

themtselves (Bilyeu, 1973, W«dl, 1972) K 

Minnesota needs * Inadequate educational 'opportunities, insuf- • . 

ficient role definition, a lack of releyant research on administrator 
preparation, the need for education at the sub doctoral level, and the ne6d 
for administrative conpetencles are all national*^factors of whicd SEATP 
plcinners were aware* However, several studies of special education admin- 
istration in Minnesota indicated training needs specific to this state, 
as summarized below. . 

As in other emergent fields, growth in special education programs 

for qualified personnel has exceeded the available 
supply. To staff expanding programs, persons with minimal experience and 
certification have been hired, creating needs for inservice or continuing 
education programs. A recent study (Sprigga, 1972) indicated that this is 
true for administrators as well as special education teachers. The majority 
of directors or administrators of special education programs had assumed 
their present positions recently; fpr most, their present positions are 
their first administrative ones. 

The same study indicated a high degree of educational level for new special 
education administrators. As a group, entry level administrators ulBually 



have a masters degree in a particular special education disability area or 
teaching specialty. They tend to be young, with three to five years of 
teaching or related professional experience, but witiTliiiited administrative 
experience. 

The educational backgrou)^d of these new special education Bdminis - 
trators tends to be. sonvewhat different from that of the typical adminis- 
trator In education. Generally , education admlnistratprs assume their titles 
^and positions only after completing a -certification program In school 
administration, but the special education administrator typically enters 
without a certification program in education or other administration or 
management training. « f ^ 

Directors of special education are often promoted by their employing 
school districts into administrative positions. New directors are probably 
selected for their positions because .of demonstrated success as special 
education teachers or for a variety of other reasons. Ihe disproportionate 
number of special educaticJn adi^lnistrators in Minnesota who were formerly 
school psychologists or speech pathologists suggests that selection might 
be influenced by prior visibility and interactions with other administrators 
within the district. Demonstrated administrative competence joes\not appear 
to be the major selection criterion. \ 

Districts with new special education administrators are frequently 
rural or small town interdict rict special education cooperatives, 
located beyond commuting distance from the IVln Cities. The special ed- 
ucation administrator is usually hired on a 12 month contract. Conr,equeutly, 
a new director is not in a po8it?on to leave his/her Job and return to a 
university of college program for administrative preparation either during - 
the school year or in the summer. Furthermore, new administrators are 
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expected both by the organizations In which they work and by the State Depar- 
tment of Education, to administer the program successfully, and, when necessary 
to learn on the job. 
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Competency-4)a3ed education 

Traditionally 9 preparation programs for teachers and administrators 
of educational programs consisted of a set of experiences which the 
prospective practitioner must undergo prior to receiving licensure or 
certification in his profession* Such programs tended not to specify in 
detail the tasks prospective educationists needed to be able to do or 
accomplish to qualiCy for licensure, nor was thete any objective guarantee 
that graduates^ of such programs had been prepared 'to perform the tasks 
actually expected of them once they actually assumed teaching or admin- 
istrative position. 

Criticisms of traditional teacher preparation programs have been 
mounting since the 1960 's, and the sources of discontent are varied. 
Some sources of c^ssatisfaction are general, including the increasing 
awareness in the last decade of lack of progress in meeting inadequate 
cies in education and the implications that vastly improved preparation 
requirements are necessary both to meet changing conditions and to main- 
tain the viability of public educational systems. Correspondingly, 
demands for relevance of preparation programs have increased, resulting in 
demands for participation of present and prospective teachers in deter- 
mining education goals and methods. Another source of demands for change 
ill teacher preparation programs comes from advances . ^ade in the art and 



science of teaching. Technological^ development, experimental instructional 
models and the increased availability of federal funds to support these 
research and development efforts have enhanced the possibility that im- 
provements in fact could be made. And undergirding all of these is the 
increasing pressure for accountability in educational programs. 
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What Is competency or performance-abased teacher education? The AACTE 
Committee on Performance^-Based Teacher Education (1974) has offered the 
following definition: « 

1. The Instructional program Is designed to bring about 
learner achievement of specified competencies (or 
performance goals) which have been 

. derived from systematic analysis of the performance 

desired as end product (usually that of recognized 

practitioners) and 
• stated In advance of Instruction In terms which make 

It possible to determine the extent to which compe- 

tency has been attained. 

2. Evidence of the learner's achievement 

] • Is obtained through assessment of learner performance, 
applying criteria stated in advance in terms of 
expected levels of accomplishment under specified 
conditions and 
. is used to guide the individual learner's efforts, 
to determine his rate of progress and completion 
of the program and, ideally, to evaluate the efficacy 
of the instructional system and add to the general 
body of knowledge underglrding the instructional 
process* 

The foregoing implies, of courae, that: 

1. Instruction Is Individualized to a considerable extent. 
2* Learning experiences are guided by feedback. 

3. The program as a whole has the characteristics of a 
system. 

4. Emphasis Is on exit requirements. 

5. The learner Is considered to have completed the program 
only when he has demonstrated the required level of 
performance. 

6. The Instructional program is not time-based in units 
fixed duration, (p. 7) 

The terms "competency-based" and "performance-based" education are 
often used to refer to the same movement. "Performance-based" terminology 
stresses the manner in which the learner demonstrates knowledge and skills 
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and iotplles that knowledge gained must be employed in overt action* 
"Competency^based" terminology stresses the notion of a minimum standard 
for effective performance. Both Identifiers connote educational programs 
that go beyond knowledge fotylts own sake, and emphasize performance and 



In the majority of cases, competency- or performance-based education 
has been used for teacher preparation; less use has/ been made of the concept 
Indeveloping or organizing training programs for school administrators. 
Although competency-based preparation for school administrators is required 
or recommended as a basis for certif^ication in Minnesota and other states, 
specification of competencies often has not yet reached the level of 
behavioral or at least measurable objectives (e.g., Dederick, 1973). In 
addition, most of the competency-based education literature is concerned 
with undergraduate preservice preparation of teachers, and less use is 
made of the concept for graduate continuing education programs. 

Despite the lack of many precedents for competency-based continuing 
education programs for administrators, educational^needs seen by SEATP 
planners suggested that a competency-based approach might well be appropriate 
and profitable for this program* The emphasis on performance goals, system- 
atically defined and derived from the performance o:f recognized practi- 
tioners, is relevant to the lack of role definition noted earlier y The 

^ X 

emphasis on assessment of both learner progress and effectiveness^ of the 
instructional system permits continued refinement of a relatively experi- 
mental program in its developmental phases* In addition, the flexibility 
offered in delivery of services increases the probability that the 
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program can be adapted to the variety 




which exist even within 



a given position .In a single state* 
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In special education, factors in addition to those mentioned above 
have resulted in changes in training programs. The field has grown a^ an 
unprecedented rate — both in numbers of pupils served and in sophistication 
of practitioners. Major shifts in orientation (e.g., away from the "medical 
model") have created training and retraining needs. Another source of 
demand is the number of persons in special education programs not appro- 
priately certified, despite the general oversupply of teachers, and who 
requiri training programs that are at one and the same time entry level 
training zxid continuing education. 

In response to these conditions, the movement toward competency- 
based or performance-based teacher education (CBTE or PBTE) has emerged. 
Advocates of competency-based education programs assert that benefits of 
adopting this approach will be felt throughout the educational system, 
and the payoffs are both immediate and long range. CBTE/PTBE promises: 

Long range To improve quality of instruction in 

(10 years) the nation's schools, and in con- 

sequence to improve teacher education. 

Intermediate range To prepare knowledgeable and skillful 

(4-10 years) teachers in a curriculum whose elements 

have been tested for validity against 
criteria of school effectiveness. 

Short range To identify tentative teacher compe- 

(0-4 years) tencies, to prepare instructional 

materials and evaluation procedures, 
and to establish conditions to vali- 
date teacher education curricula and 
promote teacher behavior research. ' 

Almost immediate Stronger relationships between teacher 

educators, public schools and the 
organized teaching profession. 

i 

Greater student satisfaction with skill- 
oriented teacher education programs. 

Increased accountability of teacher 
(Rosner and Kay, 1974, p. 294) education programs. 
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PROGRAM OPERATION 

SEATP characteristics 

The University of Minnesota has had a preparation program for adminis- 
trators of special education for a number of years. Like most conventional 

I 

*;programs, it has been an on-campus program, focusing on training a limited 
number of persons at the doctoral level. 

ToVeach the majority of new directors for whom the existi^^ig degree 
program may not be desired- or appropriat^, the Special Education Admlnistra- 
tion Training Program (SEATP) has been developed as an alternative education 
sequence .\ It has been designed specifically as a response to the conditions 
indicated in the previous section, but also is seen as having the_pqtential_ 
for widespread adoption for training special education administrators in 
other |states or for training administrators and practitioners of other human 
services programs. SEATP has seven basic features: 

1. TbA objectives of SEATP are stated as competencies of a director of 
special education. , 

2. These competencies or performances are derived empirically from examina- 
tion of the job which existing special education directors perform. 

3. There exists an identifiable core of minimum essential competencies for 
all director of special education positions, despite variations in 
individual job descriptions, scope of authority ,\ line or staff designa- 
tion, size of program, and single or multidistrict organization. These 
core competencies constitute the SEATP curriculum. 

4. Instruction received by a participating director of special education is 
based on his or her individual needs as determined by prior and ongoing 
assessments. 

Instruction is field centered. 

18 
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6« The types of ^Instruct Ion offered emphasize teaching of facts and concepts 

anii the practice of skills relevant to perfonaance In the position* 
7« The basis for evaluation of the success of the training program Is student 
Cadainlstrator of special education) practices, learnings and performance* 
Each of these seven points will be discussed in greater detail below, 
along with corollary descriptive characteristics of the program and an Indlca- 
T:lon of assumptions on which these characteristics are based. 

Competency-based education * The first characteristic of this program, 
its coiQ)etency->based orientation, reflects a number of current educational 

\ 

trends. The recent press for accountability in educational programa.^^he"'"'\^ 



desire to reduce fragmentation-and-oveiflap in training sequences, the need to 



individualize instruction, and the advantage of communicating to the paijtl- 
cipating student what is expected of him have all contributed to the emergence 
of competency-based training programs in teacher education* In some cases, 
a competency-based orientation is required of training programs for their 
graduates to receive state certification, although Minnesota certification for 
directors of special education has not at this time specified which competen- 
cies are to be attained. In SEATF, the competency-based orientation also serves 
to integrate the diverse elements which could usefully go into the content of 
the program and to facilitate participation of persona from various disciplines. 

Competency-based instructional programs aasWe that the competencies 
or perfoxrmances which constitute an educational nrogram can be identified 
and stated. Although some people will contend that this ls<a controversial 
point in competency-based teacher education, the results from needs assessment 
activities and review of literature in the field of special education adminis- 
t rat ion strongly suggest that coin>etencles in this area can be identified and 
stated. 
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En^lrical derivation of competencies . Traditional training programs 
attempting to convert to the competency orientation have sometimes tended 
to rely on the judgments of university faculty as a means of deriving com- 
petencies. The second SEATP program characteristic is the method of deriva- 
tion of coxi5)etencies for this training program, which has been done by 
surveying the population at which the training program is directed. Although 
a consensus on competencies by experienced special education administrators 
'at local, regional, and state levels, and college and university faculty 
has been obtained, a study of the role and function of the director of 
special education and observation of Minnesota special education directors 
has also been used to empirically derive those tasks and those performances 
^ich constitute the special education administrator's job. Competencies 
for this training program have been derived from these needs assessment 
activities. (The methods ^used to derive SEATP competencies are described In 
the program development seiption of this paper.) 

Although this basis for establishing educational program criteria may 
appear to assume a certain amotint of stability in position description, it 
" is recognized that any position is a dynamic and changing one and that 

preparation programs will require concomitant revision. Regulations, 

\ 

increases in knowledge in the field, and changes in accepted practices will 



all\ influence the knowledge, attitudes, skills, and task capability necessary 
for minimum performance in a generalized position. Consequently, Instructional 
conteht and performance criteria will change over time, as the /j olr~chan"gesT~ 
The program design provides for regular periodic reassessment pf conpetencies 
essential for perofrmance of the special educaiton administrative position. 
Some adjustments will be made on an ongoing basis; overall reassessments of 
specific competencies will be made every three years and at any time when 
changes in education organization, operations, legal constraints, and 

20 
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external forces (e.g., medical progress) suggest that the position has under- 
gone substantial change. 

Core competencies . The program asserts that there exists an identifiable 
core of minimal essential competencies for all special education directors, 
that they can be agreed upon, and' that those coiq>etencies will form the con- 
tent or curriculum of the preparation pro-am. SEATP personnel are well 
aware of the variations which occur among specific positions in Minnesota, 
some of which vary systematically according to location (i.e., urban, suburban, 
or rural; single district or inter-district cooperative; or size of program); 
others according to range of responsibilities and amount of authority given 
a specific director. Additional sources of variation are idiosyncratic to 
the needs and desires of a particular school district. Consequently, employers 
recruiting prospective special education administrators may desire performances 
and skills not included^ in this training program. However, these tend to be 
in addition to the minimum core skills which have been identified repeatedly 
through studies conducted under this training program and elsewhere. SEATP 
assumes that persons who have attained these core^ skills can function in an 
entry level position and can adapt to the variations which occur among 
districts. 

Individualized lust ruction . Competency-based preparation programs make 
it possible to pinpoint individual needs. This program assumes that, despite 

a common lack of experience on the job and little prior formal preparation 

' _ r 

in education administration, new special education administrators will vary 
in the extent to which they have already attained the mlnlmaf^essential 
competencies. Initial performance on domain-referenced tests of content and 
on performance in simulations will determine specific preparation objectives 
for each participant. Consequently, the amount and content of instructional 
experiences will vary among participants. Continuing assessment throughout 
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the course of the preparation program will also enable the program to 

adjust to various rates of participant learning. This accommodation to 

individual needs applies both for instruction conducted in a group and 

on an individual basis* 

Field-centered instruction * A prominent feature of this program is 

the location of instruction. Special education administrators tend to 

be scattered throughout the state. Because of their eleven and twelve 

t 

month contracts, they are generally unable to attend classes held on 
the University of Minnesota campus in the Twin Citfes. Instruction under 
this peeparktion program is therefore field centered. A number of pro- 
gram^^ objectives can be met through individual study. Ongoing monthly 
group and individual meetings with field consultants (experts in specific^ 
coi\j:ent areas — e.g., fiscal) are scheduled in locations close to the 
participants* residences '^nd places of work. The program assumes not 
only that field-centered instruction will increase the possible number of 
patL/icipants who are willing to take further preparation but also that 
th^ field setting is appropriate to the instruction to be offered. 

Curriculum . The content of instruction offered through the prograia ^ 
is also distinctive; it attempts to teach basic facts (e.g., knowledge 
of special education laws) concepts (e.g., program budgeting) and skills 
(e.g., ability to develop a child study subsystem). Methods of evaluation 
of the program are consistent with these kinds of instruction, consisting 
of demonstrated retention of the facts, concepts and skills presented 
and performance^^or application (actual or simulated) of skills taught. 
The assumption is made that a person can be successful on the joH if he 
can demonstrate those skills and that knowledge. In many cases, applica- 
tion of skills taught to actual problems encountered in the administrator's 
ongoing cycle of activities will be required. 
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As indicated earlier, participants are trained at the master's level 
prior to entry into the program. Consequently, philosophical considerations 
are not stressed; nor are there extended direct attempts to influence 
attitudes. However, newly appointed novjice special education administra- 
tors can profit from 4«teracti6ns with experienced school administrators 
and with their peers (other special education directors). It is expected^ 
that field consultants will serve as role models for the new directors. 
At the same time, use of field consultants represents deployment of valuable 
training resources often overlooked in traditional administrator pre-' 
paration programs. 
Performance evaluation 

The basis for evaluation of the Special Education Administration 
Training P*-ogram is the student *s (special education administrator) 
learning and performance (evaluation methodology is further described in 
the program development section of this paper) • 

As indicated above, there is a direct relationship between training 
offered and methods of evaluation. No attempt is made to show effects 
of this preparation program on student (child) learning. .One reason for 
this is that effects of staff development on children's progress is still 
not quite clear and a topic that generates considerable controversy 
within comptency-based teacher education. Besidec, there is little reason 
to believe that a direct result of administrator preparation will be seen 
-f7om -improvement in child learning, even though pupil growth and develop- 
ment is the purpose of all school-related activities. 

Essential program characteristics, corollary i.haracteristics, and 
assumptions on which these features are based are summarized in Table 
1. 

Insert table 1 here 
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Table 1 

Special Education Administration Training Program Characteristics" 



Characteristics 

1. Goals of the training 
program are stated 
as; co^peiei^cies or 
performances 

2. Performances are 
derived empirically 
from job 



3. Core'of minimum 
essential competencies 
will be taught 



4. Instruction is based 
on individual needs 



5. Instruction is 
field-centered 



Corollaries 



Training content and 
performance criteria 
will change over time 
as does job 

Other performances may 
be desired far specific — 
positions 



Amount and content 
will vary. Rate of 
progress will varv 



Assumption s 



Relevant goals, can 
be identified and 
so stated 



This is a reasonable 
preparation base 



Those skills can be 

-agreed-upon, 

Perisons with these 
core skills can 
function in entry 
level positions 

Varying levels of 
prior training, 
experience, and 
ability 

Continuing education 
for employed persons. 
Location is appropriate 
to the training to be 
offered. 
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6. Kinds of instruction 
taught— facts, concepts 
and skills 



7. Evaluate training 
program by student 
(director ) learning 
and performance 



Evaluate by demonstrated- 
retention of information 
and performance (Actual 
or simulated ) of skills 



-Person can be 
successful in job 
if he/she has those 
skills and that - 
knowledge. 

Ihere is that direct 
relationship. Can't 
show effects on student 
(child ) learning. 
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Service delivery system 

The manner in which the above characteristics appear in actual operation 
can perhaps be more easily understood by listing the cycle of activities 
included in SEATP as implemented. The purpose of the present section 
however is to describe in cKronological' sequence a special education 
administrator's activities as a participant in this program. A 
schematic representation of the service delivery system is shown as 
Figure 1. (A note on the source and rationale for the modeling language 
used can be found at the end of the program development section of this 
paper.). 

Insert Figure 1 here 




Selection (component 1.0 of Figure 1) . Minnesota special education 
directors are eligible to participate in the program if they indicate 
interest and meet the initial selection criteria. At the present phase 
of SEATP development selection criteria are limited experience as a 
director of special education (less than three years), little or no 
formal training in educational administration, and a capacity limit of 
25 participants. These crltei^ia were kstablished to maximize immediate 
impact of the project in its formative phases. In the future, partici- 
pation will be open to all interested. 

Program planning (components 2.0 and 3.0) . Following acceptance into 
the program, a participant's first activities consist of an assessment of 
individual needs. First, participants are administered a cognitive domain- 
referenced test covering knowledge and application of facts, procedures, 
and concepts for all objectives in each of the three curriculum areas 
which have been identified: fiscal management, personnel management, 
and special education program development. The format of the test is 
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a series of approximately 300 multiple choice » true-false, and similar 
questions In each of the three curriculum areas, (If available Information 
such as results of prior training, Indicates that a participant has 
already mastered an area, the test can be shortened accordingly,) 
Results are analyzed to determine areas In which participants do and do 
not have requisite knowledge, using predetermined SEATP criteria. Areas 
of deficit for each participant become his training objectives. (Criteria 
for adequate cognitive levels are established by correlating domain- 
referenced scures with performance assessment results.) 

In addition to the domain-referenced test, assessment includes rating 
of participant's performance using simulations of tasks necessary to the 
position and self-reporting of on-the-job performance. Simulations are 
rated Independently by a panel of judges, and the majority opinion Is the 
participant's score. As with the domain-referenced test^ performance 
areas are compared with the predetermined criteria, deficits are deter- 
mined, and the results are used to formulate individual training objectives 

Cognitive pretests are administered via mail and are returned and 
analyzed prior to the performance assessment. Performance simulations 
are conducted in a workshop setting. The workshop is not only a con- 
venlent vehicle for performance assessment, but also provides an oppor- 
tunlty for initial Instruction In the objectives f6r the participants 
and for program planning with SEATP staff. In addition, the workshop pro- 
vides orientation to the field experiences in which participants are to 
be engaged. 

Instruction (components 4.0 and 5.0) . The participant's program in 
the field requires con^letion of course materials appropriate to his/ber 
needs, provides periodic consultant assistance in improving performance, 
and allows opportunities for small group Interaction on problem-solving 
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exercises. 

First, the participant is sent a set of appropriate field materials 
and activities for each objective in which the pretest showed his/her 
performance to be below the criterion level. Course materials include 
presentation of concepts, source materials, and alternative suggestions 
for methods of implementing the concept. Participants then complete an 
exercise demonstrating their ability to implement the concept as it 
applies to their job; in many cases, course exercises are tasks which 
must be done on the job in any event (such as developing a child study 
subsystem). Exercieses are assessed by authors of the course materials, 
who base their judgments on evidence that the participant has correctly 
understood the concept and application of the concept is appropriate 
to the participant's situation. Exercises are rated **accep table," "incom- 
plete," or "unacceptable", and comments are included. This part of the 
field experience is conducted by mail. 

Course authors' critiques are reported not only to -participants but 
also to the participant's field consultant. Field consultants are 
persons who are expert in a particular curriculum area (e.g., personnel, 
fiscal, and program development), and who work in the same geographic 
area of the state as a group of participants. In jnany cases, field con- 
sultants are persons with whom participants are likely to have ongoing 
communications after the training program is completed. Each field con- 
sultant meets monthly with a group of participants who are studying in 
similar curriculum areas. During these day-long meetings, assignments 
are reviewed and problems are discussed. The primary role of the field' 
consultant is to assist the participant in maximizing his/her achievement 
in both cognitive and performance areas, rather than to evaluate the par- 
ticipant's performance. Field consultants do have an evaluative role, 
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however, their reporting of problems encountered with instruction provides 
a valuable source of feedback for course authors and project staff in 
order to improve instructional materials. Participant evaluations of each 
instructional package and posttest scoras are also utilized to determine 
areas of improvement in the course materials. 

Following review with assistance by a field consultant, participants 
may modify or redo course activities as needed, and the same procedure — 
assessment by course authors and review by participant and field consul- 
tant — is repeated until adequate performance is attained. This cycle of 
input from course materials, practice or exercises included as part of 
the course materials, feedback on adequacy of performance, and assistance 
in improving performance continues throughout thp training program. ' 

Evaluation . After a participant 'satisfactorily dompletes instruction 
in a curriculum area, the assessment prjocess (c6nq)onent 2.0} is. repeated, 
using posttest versions of both the domain-referenced test and the 
performance simulation. The cognitive posttest for an objective. The 
post-instructional performance assessment given after instruction each in- 
clu^^-items directed only at the areas in which the participant was rated 
deficient on the pretest. 

Credit . As indicated earlier, administrative certification is usually 
circumvented for entry Into the position of special education director. 
It is possible that training offered (i.e., competencies attained) under 
this program could be directly applied toward future certification as 
certification requirements are rev' 'ed, but at present this is not the 
case. Participants have the option of obtaining graduate credits in 
educational administration, which can be applied to a degree program for 
their SEATP coursewcrk. However, the student must also meet other 
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graduate requirements currently In existence to qualify for either of these 
degrees* Consequently^ component 6.0 of the service delivery system 
cannot presently be Interpreted In Minnesota to Include state certification, 
although certification could be readily Incorporated. It might also be that 
competencies certified through the SEATP could be used to meet continuing 
education requirements established by the state, local, district, or other 
agency • 
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PROGRAM DEVELOPMENT MODEL 

Previous ^ectlons of this paper have attempted to provide the context 
from which the Special Education Administration Training Program emerged, 
to describe the program In operation, and to defend some of the assumptions 
on which It Is based. The present section Is directed at persons Interested 
in the manner In which SEATP was developed, or who might wish to consider 
adopting or adapting some of the essential features of the program to 
other Instructional programs. 

A systems approach will be used to clarify the basic phases or com- 
ponents involved In program development which are discussed along with 
examples of specific SEATP procedures and Instrumentation. The modeling 
language used to Illustrate the model was developed by Silvern (1972) 
^and shows the flows of Information through the system. Systems models of 

c 

this type are Intentionally d^iveloped at a general level and never change 
their major elements and relationships during^ Implementation. This focus 
on Inputs, activities, and outputs has the advantage of being relatively 
independent of content, and a program stated in systems terms can be more 
readily adapted to any field in which similar initial conditions obtain 
(i.e., where performance can be observed). 
Overview 

In its most general form, the SEATP model is relatively straight- 
forward and has many features in common with other competency-based education 
programs. 

Figure 2 indicates the sequence of developmental activities. First, 
the position or group of persons for whom an educational program is to be 
developed is specified and their charactedstics and training needs are 
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described. Second the competencies which persons in that position should 
obtain are identified, based on characteristics of the position itself* 
Preparation of instruction and development of an assessment sy,3tem proceed 
concurrently, as these two are interdependent. However, as the feedback 
arrows indicate, assessment affects the instruction component of the model. 
With the possible exception of initial designation of the population to be 
trained, development and modification of the training program are based 
upon objective data to a larger degree than is usual in teacher training, 
and most data management is computer based. 



Insert Figure 2 here 

Table 2 also provides an overview of the model by listing major 
program development questions to be answered for each component of the 
model; satisfactory decisions in response to each question may be considered 
to be the goals of that component. It also lists data sources (which will 
be discussed further below) that provide a basis on which SEATP program 
managers can make rational decisions. 

Insert Table 2 here 

Needs assessment 

The first program development taskj represented in Figure 2 as com- 
ponent 1.0, is to identify the target position, to estimate the'extent 
of need for training within this target population, and to describe the 
population. 

For some education< programs, surveys of needs for preparation programs 
may tend to be bypassed due to legislative mandate or other external 
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Component 



Table 2 
SEATP Development Model 

Major .Questions (Goals ) 



Sources of Information 



1.0 Identify target 
population/position 



2.0 Identify 
competencies 



3.0 Prepare instruction 
( materials, instructors, 
logistics. etc. ) 



Is there a need for training ? 
Who should be trained ? 

How can these persons 
be described ? 



What do position incumbents 

have to do ? 
What do they need to know in 

order to-pi^rform adequately ? 

How should content be limited ? 

How should instruction be 
organized (service delivery ) ? 

What materials /strategies for 
learning are available or 
need to be developed ? 

Who should provide instruction ? 

What instructional components 
or other factors influence 
probability of reaching 
training objectives ? 



Legislative (or other) mandates 

or preferences 
Literature in the field 
Requests made lO training 

institution 
Needs assessment (e.g. .demand 

personnel, present training 

levels of possible target 

populations) 
Data from prior training 

Goal analysis 
Job analysis 

Anthropological field study 
Data from prior training 

Judgements of professionals 
in the field, instructors, 
and participants 
Literature in the field 
Data from'prior training 



4.0 Develop assessment 
system 



What courses should 

participants take ? 
What changes in competencies 

occur during and after 

instruction ? 



Pre and post domain -referenced 

testing 
Pre and post performance 

assessment 

•Performance on course 

materials exercises 
Data from prior training 
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directives. For others, demonstrating that there is a need for a prepara- 
tion program is necessary to secure funding and other resources, and may 
be incorporated as an ongoing function of University self-examination and 
renewal processes. 

Adoption of a competency-based approach implies that definitions of 
need for preparation programs are derived from end/or supported by a 
description of tne population to be trained. Internal consensus among 
faculty, although obviously desirable, is not regarded to SEATP staff 
as sufficient to establish needs without supporting documentation obtained 
from the field. Information gained from this initial planning phase is 
useful in delimiting the content and determining organization ol instruction 
(component 3*0 discussed below)* 

SEATP itself used a number of previously available sources of infor- 
matiqn in delineating the population to be educated, A review of the 
literature yielded summaries of the typical preparation and experience 
background of Minnesota special education directors (c*g*, Spriggs, 1972; 
Bilyeu, 1973; and Wedl, 1973) which, along with a review of presently 
available educational opportunities, suggested that priority by given to 
expanded and improved preparation in administrative skills for present 
incumbents of these positions* As SEATP is implemented, data from prior 
training efforts provide additional sources of information regarding the 
target population to be trained. 

Other programs may wish to use similar means, or may rely on 
demographic studies, internal and/or field surveys, Delphi probes, etc* 
Competency Identification 

The second component of the SEAT? program development model is the 
process by which competencies or desired performances are identified* A 
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multldlscipllnary approach is used, employing three strategies (goal 
analysis, job analysis, and an anthropological field study) which are 
used to cross-validate each other. Each of these strategies has previously 
been used alone as the basis for performance specifications. Together the 
strategies present a reliable and more valid description of the minimum 
essential performances for a particular position, especial^ly when viewed 
from the extent to which those three strategies duplicate each other. 

The specification of competencies or performance criteria are illus- 

/ 

trated in Figure 3; each of the techniques employed is described bfilow. 



Insert Figure 3 here 
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Goal analysis . Goal analysis is Mager's (1972) procedure for obtaining 
consensus among a group of people, and includes the followf.ng steps: First-, 
a panel is selected, descriptive words and phrases are elicited from each 
panel member, and all responses are recorded. The panel then meets to 
edit the list. Members eliminate duplication and non-essential items, fill 
in deficient areas, and rewrite the list in performance terms. The group 
then rates each item for desired level of performance, specifies the 
Importance or centrality of achievement at the task, and agrees to the 
accuracy of the resulting material after it has been edited into correct 
statements of behavioral objectives. 

The goal analysis provides the general statement of performance which, 
when combined with the specific skills, tasks and knowledge from the 
position (job) analysis, allows relevant behaviorally stated objectives to 
be developed for the position being studies. Crucial to effective goal 
anaJysis is the composition of^Jthe panel. In the case of SEATP, the special 
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education administrator's job functions (as determined by literature 
review) were divided into three parts — fiscal management, personnel manage- 
ment , anJ special education program development—and separate panels were 
convened for each fu»\ction. This permitted selection of specialists in 
specific areas to participate as panel members without making each group 
unduly large. Each panel included representatives from local school 
districts, regional consultants. State Department of Education staff, and 
professors of educational administration and special education, 
\^ Job analysis . Job analysis, the second strategy, uses a set of 

procedures derived from industrial psychology for careful study of a 
job within an organization. It has been defined by the United States 
Bureau of Employment Security (1965) as 

c> ,,,the process of identifying, by observation, interview and 

study, and of reporting the significant worker activities 
and requirements and the technical and environmental facta 
of a specific Job, It is the identification of the tasks 
which comprise the Job and of the skills, knowledges, abilities, 
and responsibilities that are required of the worker for 
successful performance and that differentiate the Job from 
all others, (p* 5) 

A number of different methods may be employed in conducting 1ob analysis. 
These include questionnaires and checklists, observation, individutil or 
group interviews, logbooks, or judgments about good and poor job per- 
formance^ 

Previous studies of special education administrators tended to 
utilize analysis of existing job descriptions and self-reporting by 
questionnaires sent to directors. The SEATP Job analysis used these 
procedures, but supplemented them with direct observation and structured 
interviews with a small stratified sample of the population. Tasks, 
skills, and knowledge reported by any of these means were summarized, 
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distributed to all directors for comments , and aodlfied as needed. The 
resulting p-sitlon description is contained In the job analysis final 
report (Harpaz, 1974). 

• Specificity and inclualveneas characterlte differences between results 
of goal analysis and that of job analysis. Results of the job analysis 
Included a lengthy^ enu^ratlon of all those specific taski which every 
Minnesota director perforsacd. Goal analysis, cm the other hand. Included 
judgments of centrallty or Intportauce of more "global" performances and ; 
may have omitted some tasks entirely. The two procedures were used to c^'xk 
each other and produce a more accurate description. 

Anthropological field study . Data from the anthropological study are \^ 
Intended to further improve tb;8 validity of the performance specification 
by identifying cultural parameters for the curriculum as well as by 
identifying minimum essential performances which substantiate those 
pr^^vinusly identified in the goal analysis and job analysis or which were 
overlooked. This approach tends to produce data not readily available 
from other sources, such as the annual cycle of activities of a special 
education director, information sourcas, and decision making 
processes. It documents the vast numbers and types of coamunity and state 
agencies, and adslnistrators and staff with whom the director comawnicates 
both routinely and occasionally. It also assesses the influences of 
different organizational structures upon the special education director's 
role. 

The anthropological study utilizes ethnographic techniques and systems 
analysis. Participant observation in the form of participant-as-observer 
(as used by Harry Wblcott In his 1973 study of an elementary principal) 
provides the methodological base, supplemented and cross checked by several 
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other methodologies: present and past logs kept by directors, a time 
study. Interviews, Information on the director's calendar, and drawing of 
decision-trees, tor the SEATP study, each of three directors of special 
education In three representative communities (urban, rural and rural- 
urban) , representing three different types of administrative units (single 
school district, cooperative in and Educational Service Area and cooperative 
not in an Educational Service Area) are studied one week each month for 
one year. 

Data from the anthropological study have multiple uses. -If the study 
is begun well in advance of program implementation', it can be used in 
conjunction with the goal analysis and job analysis for initial competency 
specification. If carried out concurrently with instructional program 
activities, it serves to refine or modify initial performance statements. 
In either case, anthropological data are useful in setting up a framework 
within which simulations, course exercises, test questions, etc. can be 
devised. * ' 

Revalidation of competencies . It is recognized that position 
requirements have a tendency to change over time. In most positions, job 
requirements^^^id^competencies will not show substantial differences over 
time spans of less than three years. Consequently, SEAT? Intends to 
repeat goal analysis and job analysis procedures every three years to 
revalidate performance specification as director duties and competencies 
change. The anthropological study will also be repeated; the necessity for 
this is based upon the assumption of changes in the culture (Theoretically, 
dramatic cultural changes are expected to occur once a generation — aboult 
20 years* Data to support this time period is lacking, however, and 
further effort to develop a sound rationale is recognized as necessary.) 
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Preparation of Instruction 

Components 3«0 (Prepare instruction) and 4.0 (Develop assessment 
procedure) are, chronologically, concurrent procedures and both should 
begin as soon as initial competencies have tentatively been Identified • 
Indeed, the nature of the interrelationships between the tvo sJuggest that 
development of perfomaance measures might preceed curriculum ar^d other 
instructional preparatlou. 

Preparation of instruction (see Figure 4) begins by delimltiing the 
curriculum in view of priorities established in the goal analysis; job 
analysis and anthropological study; available information on presti it 
competency levels of the target population (such as preliminary assessment 
results); and pragmatic considerations such as time, extent of funding, 
and other resources* Once the scope and sequence have been determined, 
course preparation begins by selection of course authors who are specialists 
in specific content areas* These persono are provided with course objec- 
tives (the outcome of the competency identification process) and with 
questions from the domaln-ref erenced test which pertain to those objectives 
(when available). 

Course authors are responsible, during developmental phases, for 
selecting and/or writing appropriate reading materials and for preparing 
exercises on each phase of the content area to give the participant an 
opportunity to practice the skills b<*ing taught and to apply concepts 
which have been presented. (As indicated earlier, course authors have a 
continuing function* During operation of training, they evaluate performance 
on the course exercises and thus provide the participant with feedback on 
the. extent to which concepts and skills have been mastered) « 



Insert Figure 4 here 
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Parallel to the development of curriculum and materials is develop- 
ment of the service delivery system. Needs assessment data on the popu- 
lation to be trained and known parameters of the content of training 
provide some cues to delivery requirements which must be met and resources 
(such as field consultants) which can be utilized. The service delivery 
system used for SEATP has already been presented in an earlier section of 
this paper. This can be used or adapted for a wide variety of programs. 
Logistical details may vary with each similar program developed. 
Assessment 

The fourth component of the SEAT? program development model — assessment- 
is one of its most important features. Ag a competency or performance based 
program, SEATP is by definition a data-based system: 

Assessment lies at the heart of PBTE. Goals of instruc- 
tion must be stated in assessable terms; learner performance 
must be assessed and reassessed throughout the instructional 
process; evidence so ob^lned must be used to evaluate the 
accomplishments of the learner and the efficacy of the system. 
Remove assessment from PB^E and all that is left is an enumera- 
tion of goals and provision of instruction which hopefully will 
lead to their attalnment^ntott much on which to pin one's hopes 
for significant improvement in an educational program. 
(AACTE, 1974, p. 18) 

The SEATP emphasis on assessment serves two major purposes similar to 
thost just alluded to. First, it enables program managers to determine on 
an ongoing basis the extent to which participants achieve, at the criterion 
levels, the program's objectives. Second, it permits objective deter- 
mination of the appropriateness of instructional methods, content of 
instruction, and established criterion levels for achievement. 

The SEATP program focuses on competencies necessary for performance on 
the job, and thus employs two basic strategies to determine the extent to 
which these competencies are attained: performaiice assessment, using 
simulations of actual tasks which all special education administrators 
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must perfomiy and cognitive assessment, or measurement of the knowledge 
which a participant must have in order to perform essential job tasks. 
These measures are obtained on a pre and post basis. 

Other data are less formal, and are collected at various points prior 
to, during, and following the provision of instruction. They include 
information regarding participants* perceptions of their competencies and 
the training they are receiving, results of course exercises completed in 
the field, and reactions of field consultants in a position to observe 
participants* work. 

Complete descriptions of all instruments, subjective and objective 
data collection procedures, and methods of analysis can be found in the 
project's evaluation design (Deno, 1974). The following discussion will 
focus on those procedures and instruments which provide objective evidence 
of competency levels. 

Figure 5 indicates the procedure followed for developing and modifying 
the procedures for cognitive and performance assessment of competencies* 
A more detailed explanation and flow chart for the assessment system, as 
implemented, can be found in Hendrix (1974). 



Insert Figure 5 here 



Performance assessment . Performance assessment consists primarily of 
a series of special education administrator job tasks, derived from program 
objectives, performed in simulated settings which approximate field 
conditions and rated by experts for adequacy* (Performance assessment by means 
of structured observations of participants* actual performance on the job 
was Investigated, but discarded as not feasible due to high costs.) In 
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addition, participants* self-ratings of perceived proficiency levels are 
obtained and compared with observed levels. 

Simulations developed for use in SEATP have been tailored to the 
specific situations an administrator will encounter. For example, SEASIM 
(Special Education Ad Inistration in Monroe City) simulation materials 
(UCEA, 1973) which are related to program objectives have been rewritten 
to apply to rural and multi-district programs* In many cases, however, no 
materials were available and these had to be developed by project con- 
sultants and staff. 

Initial performance assessment (simulations and self-ratings) takes 
place at a pre- instruction workshop. Participants are provided with all 
necessary materials, and can complete the assessment in approximately Ih 
days. 

Each simi'lation is rated by five raters; two representatives of the 
existing special education administration training programs (degree programs) 
in the state, an experienced local special education director, a regional 
consultant, and a State Department of Education special education repre- 
sentative. The current president of the state special education administra- 
torfe association is always included as one of the practitioners. Raters 
work independently of each other, and the identities of the participants 
are not disclosed to them. Each simulated task is rated "pass" or "no pass" 
according to the rater's ju^igment; the majority opinion (three out of five) 
determines the participant's score. 

This use of simulations as an assessment, tool departs from Standard 
procedures; most training programs follow simulations with immediate instruc- 
tion to improve pexfformance. Instead, SEATP uses performance assessment to 
select areas in which instruction is to be provided. During the participants 
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field experiences, feedback on simulated performance and further practice 
on those tasks through course exercises assist\in improving performance 
in deficient areas, \ 

Following instruction, participants are againXassessed in those areas 
in which they were previously deficient to determine\the degree of 
improvement. ^ \ 

Cognitive assessment . Many SEATP objectives specitjK tasks the director 
of special education is to perform, and demonstration of cotapetency is 
complete and direct (performance of the task in a setting which simulates 
actual working conditions). Measurement of these tasks may be considered 
to be criterion-referenced. However, the knowledge (information, grasp 
of concepts, and ability to apply them appropriately) required to perform 
Job tasks must be inferred, and consequently domain-referenced testing is 
used for assessment of achievement in cognitive portions of the training 
program objectives. 

In domain-referenced testing, the goal is to create an e>>tensive pool 
of items which represents, in miniature, the basic characteristics of some 
iinportant part of the original universe of knowledge (domain) (Hively, 1974). 
A domain must be capable of being described very specifically both in terms 
of content and format. The major advantage of domain-referenced testing 
is that it allows astimates, from a small sample of items, of the participant's 
"level of functioning," or the percentage of the total tasks of a specified 
type which would be answered comtctly. The reliability of the test is the 
accuracy with which the probabilities of correct performance can be estimated. 
Validity can be assessed by logical analysi« of the domain definition, the 
item generation scheme, and the individual test items (Millman, 1974). 
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The "domain" reL^rred to for SEATP purposes is an educational objective* 
Consequently, in developing assessment procedures for any objective with 
a cognitive component, an attempt was made to generate a large set of 
test items which would represent the "pool" for that domain. The number 
of items generated was limited by practical constraints — cost and (computer) 
space. SEATP currently has on file 100 test questions for each objective. 
A domain or objective is regarded as fixed for the period between revalida- 
tion of competencies (program development model component 2.0 above), but 
the content of that domain may change at any time, and test questions are 
periodically reviewed to determine their continued relevance. (For example, 
a training objective may state that a special education administrator must 
be cognizant of the requirements of due process, but a change in law or 
regulation may alter specific due process procedures which the director 
must follow.) 

AcftUal testing, under a domain referenced Kvisureaent method, is done 
by means of an instrument which is a random selection of those items which 
measure the objective. For SEATP pretests, the Items selected for Inclusion 
cover all objectives being assessed, and are randomly "mixed," An estimate 
is made of the criterion level (e.g., 80 percent correct) which constitutes 
mastery of each objective (domain) , and instruction is provided in those 
domains where the participant falls below the criterion level. Post tests 
are developed IndiTldually for eac^ participant, and consist of items randomly 
selected from each doaaln In which instruction was provided. A separate 

post test is developed for each objective to permit each participant to be 
tested as soon as he completes the coujrse, and to allow repeated (different) 
post tests on each objective until the mastery criterion is reached (practical 
constraints dictate a limit of zight post tests). 
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The aaatery crltMlon level la initially aet at an arbitrary level, 
based on the Judgment of program staff* Afdir data on domain-referenced test 
performance )and on performance assessment are available, scores on the two 
assessments are compared to determine the level of achievement on the domain- 
referenced test necf^ssary to predict ''pass" ratings on the simulations* That 
level then becomes the validated mastery criterion for the domain-referenced 
test*' 

Since participants are tested on only a small fraction of the items which 
measure achievement of each ^objective, .the reliability of a domain- referenced 
testing procedure Is dependent upon the probability that the participant's 
score on the items to which he/she responds represents the score he/she would 
attain on the entire Clnflnite) set of items in that domain* SEATP uses 
Bayesion statistical procedures (Novlck and Lewis, 1974; Novick and Jackson, 
1974) to prescribe the length of the test the participant should receive and 
to determine the criterion level which approximates the mastery criterion for 
the entire domain* ^ 

Prior to testing, an arbitrary estimate is made of the probability that 
participamts will achieve at the mastery criterion level, which is used to 
determine pretest length and the passing score for each objective. Once a 
test has been administered. Information io combined In a straightforward 
fiayesian procedure using the beta distribution to obtain prior estimates for 
the first posttest* This procedure continues imtil the estimate of the 
probability that the participant performs at the mastery level is sufficiently 
high to consider hla/her "passed*" ("Sufficiently high" Is determined by the 
loss ratio for an objective; e*g*, a loss ratio of 1.5 indicates that the 

loss associated with incorrectly passing a participant who has not reached 
the criterion level is one and one-half times greater than the loss associated 
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with Incorrectly "f alllug'' a atiadent has reached or exceeded the criterion 
level* ) For example, an eight item post test on an objective with a passing 
score of 6 (75 percent) might be recommended when the mastery criterion is 
70 percent and the loss ratio is 1.5 (the score required on the test is 
higher than the mastery criterion because of the short length of the test 
and because the loss ratio is more than 1). 

All cognitive assessment information is recorded and scored on computer, 
and the system developed for use in SEAT? contains programs and disc storage 
files which contain the Item pool; maintain the status of individual partici- 
pants in the training project; select, print » and score pre and post tests 
for each participant; and' maintain an ongoing statistical sunnary of partici- 
pants* progress through the training program. There are nine computer 
programs for these purposes: 

CI) Creation of the master item file, including additions, modifications, 
and deletions* 

(2) Recording of criterion levels and loss ratios for each objective (for 
a given group of participants, this Information is fixed). 

(3) Providing initial information on each participant which vill.be 
used in later programb (including eatimates of the probability that 
a participant has achieved the criterion level, participant training 
and experience data, etc.)* 

(4) Determination of the nusiber of items to be included in the pre test 
and random selection of items from the master file. 

(5) Determining format and printing a copy of the batch pre test for 
each participant 

(6) Scoring the pre test and updating the files for each participant 
(Including a determination of the need for instruction and for a 
post test based on a revised achievement estimate). 

(7) Examination of the participant's status and selection of items for 
a first p^st test 

(8) Printing a post test and answer sheet for any post test 



(9) Scoring post tests, updating the information file on each partici- 
pant, and generating a new post test for each objective not passed. 
(A partlc^ant may take up to eight post tests per objective.) 
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Time parameters for developmental phases 

Use of systems models such as the foregoing helps to clarify the 
logical structure of a procedure, since they arc relatively Independent 
of content* However, systems models of this type are also independent of 
time, and it is necessary to add at this point some estimates, based vpon 
SEATP experiences., of the amount of time which should be allowed for 
development of each component of a training program using the SEATP model* 

The amount of time required for initial determination of the population 
to be trained will vary with the method used and with the extent of documen-. 
tat ion of need required by relevant funding authorities* Usually, however, 
these activities are done before a training model Is selected, and thus 
time estimates for this component, are not included here* 
\^ For development of the remaining components of the model, a minimum 
of one year must be allowed; the amount of staff time and other resources 
which must be deployed during that year will vary with the extent to which 
not pnly SEATP development procedures but content (objectives. Item pool 
for domain-referenced testing, and instructional materials) can be used 

or adapted. Thus, less effort would be required to aevelop a preparation 

t 

program for special education admj^nistrators in another state using the 
SEATP roc lei than would be required to develop a comparable program in 
adminis'*:ration of other human services* One could also project that less 
effort would be required to develop an administrative education program 
than one for teachers or other direct service providers* The procedures, 
however, would be applicable in any case* 

A one year deyelopment period is necessitated by the time required for 
competency identification, due to the inclusion of both identification and 
validation procedures in the development phase* Goal ahalyjls and job 
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analysis can both be accomplished In 90 days, given favorable conditions • 
An anthropological field study to validate initially identified compe- 
tencies, however, requires an entire year, and, if possible, additional 
time should be allowed for thorough data analysis. The advantage to 
completion of the anthropological study before the program begins is that 
the information from the study can be used to develop the domain-referenced 
test item pool, performance assessment procedures, course materials, and 
course exercises. 

The job analysis and goal analysis provide the training objectives, 
which are necessary input into both the preparation of instruction and 
development of assessment components. Once objectives are known i course 
authors can be selected and materials preparation begun. If some use can 
be made of SEATP materials, or if instructional materials for objectives 
identified as high priority are readily available, instructional prepara- 
tion for a year's instruction can be done in six months. (If instruction 
is likely to be sequential, some instructional preparation can continue 
while initial course work is conducted.) 

The major tasks in developing assessment procedures, if SEATP 
computer programs are used, are preparing an item pool- and developing 
simulated or on-the-job performance assessment procedures. If many items 
in the SEATP master itei^ pool are applicable to a proposed education 
program, the task may b^ accomplished in perhaps eight months. If the 
entire pool must be developed, then a minimum of a year (after training 
objectives have been determined) must be allowed. Generation of test 
items is a difficult and often tedious process, and as many persons as are 
qualified and available should be involved in this process. Development of 
performance assessment procedures also varies ^vi;;tth the extent to which 
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existing simulation materials and other tools can be employed, but the 
use of rating rather than the domain-referenced test procedure indicates 
that proportionately less time be spent in instuntent development (and 
more in administration of the performance assessment) than is the case for 
cognitive assessmf>nt. 
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ISSUES 

The characteristics of the SEATP were not stipulated arbitrarily, 
nor did they evolve haphazard fashion* In many cases, a conscious 

effort was made to consider both the drawbacks of traditional training 
programs and the criticisms leveled at competency-based ones* This 
section will attempt to explicate and support some of the assumptions on 
which the program is based and to comment "^n issues to which this program 
is addressed* 

Competency^based education 

Appropriateness * One of the first criticisms of competency-based 
teacher education programs is the competency-based model itself, its 
validity and feasibility* Maxwell (1974) suggests that the approach is 
borrowed from the natural sciences and has been inappropriately transferred 
to a more complex and humane setting* His critique may or may not have 
force when applied to the undergraduate teacher preparation programs at 
which it is leveled, but it is less valid with reference to administrator 
prepar;^tior4. The introduction of similar concepts (MBO, PPB3, operations 
research), has provided powerful tpols for management in a number of 
areas, and, although administrator training programs are housed within 
colleges of education, administration itself is a discrete field (Simon, 
1946) , and educational administration has as much or more in common with 
business administration, public administration, hospital administration, 
etc; , than it does with teaching* A competency-based administrative 
preparation program may thus be said to have merit;^ because of the congruence 
of method and discipline* The SEAT? approach acquires some prime facie 
plausibility because it is designed around identified types of problems 
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which tend to be in areas where competency-based education does show 
these strengths. 

The question of appropriateness of a competency-based orientation 
appears in the literature in various^formulations. One of the most common 
of these is the charge that the kinds of competencies which tend to be 
included in competency-based programs appear to be dictated by available 
means of measurement. The AACTE Committee (1974) noted the tendency of 
CBTE programs to emphasize simple, easily measured outcomes, to the 
exclusion of complex performances. Broudy (1972) expands on this concept, 
saying that the broader the objective is the more difficult it is to 
measure, but the narrower, the greater the possibility that learning will 
take place by rote and will not transfer. Grasp of concepts and theories, 
which alone provide explanation and understanding, are not within the 
purview of CBTE programs, in his view. 

Although all competency-based programs are vulnerable to this charge, 
the nature of the position and the means of assessment in a program such 
as SEATP made this criticism less damaging. A relatively heavy cognitive, 
knowledge, or information base is defensible when one notes the extent 
to which administration and operation of special education programs is 
circumscribed by statutory and regulatory directives. Concepts and theories 
of administration can be and are taugb^ in these programs, but these are 
measured not so much directly as in their application to tasks which have 
been determined to be essential parts of the director of special education 
role. 

The procedures specified in the SEATP model for competency identifi- 
cation and for assessment of training outcomes make it possible to treat 
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this question as an empirical one* Data from the cognitive portion of 
the assessment scheme , which includes conceptual application, is compared 
to results of simulations of job tasks, and it will be possible to determine 
which competencies taught correlate with satisfactory levels of performance. 

An analogous criticism might be made regarding teaching of attitudes 
and philosophy. Here, however, direct teaching is regarded as low priority 
for several reasons. First, desirable attitudes $hould be reflected in 
performances rated as satisfactory. Second, much of the participant's 
philosophy of education has been covered in previous education (^a^ry 
level for special education administrators assumes a prior master's degree). 
In addition, philosophical and attitudinal considerations are introduced 
in the training sequence in indirect fashion: in course readings, by use 
of field consultants as role models, through peer interaction, etc. And, 
again, if the assessment system indicates performance deficiencies which 
may be related to attitudinal factors, instructional methods and content 
can be adjusted. 

Competency identification . Some of the most persistent criticisms of 
competency-based teacher education programs center around the asserted 
impossibility of specifying the right competencies, the lack of coherence 
of sets of competencies developed, and the methods employed for developing 
and selecting them. SEAT? has attempted to take these concerns into 
account in developing its methods of competency identification. The 
empirical approach taken, the use of multiple identification methods, and 
explicit provisions for periodic revalidation of competencies selected, as 
well as the emphasis on minimal essential competencies, represent attempts 
to resolve issues in this area. . 

In teacher education, Broudy (1974) is among those who find no avail- 
able list of the basic teacher competencies. In particular, he questions 
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the merit of research that has gone into specifying teacher performances 
and notes that contradictory results have been obtained. AACTE (1974), 
on the other hand, notes a plethora of lists of competencies, but finds them 
to be unrelated to each other, fragmented, and having no guiding concep- 
tualization of what the teacher's role is. 

These observations are probably closely related to methods used for 
competency identification. A common' method of developing competencies, 
often because the pressures of time or legislative mandate, is by top-of- 
the-head consensus, with little validation. SEATP designated derivation 
of special education administrator competencies as a major {;oal of its 
first year of operation, with multiple methods used to cross-validate 
each other. Empirical methodology, as detailed in the subsequent section 
of thlG report, included a job analysis using an Industrial relations 
model, and an anthropological field study, along with a consensus on role 
description and training objectives by a jury of experts and practicing 
special education administrators (goal analysis). Supplemental information 
on priorities was obtained by a review of a number of surveys in this 
state (Spriggs, 1972; Bilyeu, 1973; and Wedl, 1973). A convergence on 
tasks, problems and priorities has been noted. 

This use of multiple methods of competency identification also meets 
another criticism of CBTE programs, often made by teacher organization, 
that there is a lack of sufficient input from the field (Cartwright and 
Pershing, 1973). The SEATP training model is based primarily upon empiri- 
cally validated input from the field. 

Empirical specification and validation of competencies has some additional 

I 

payoffs: It pushes educators for clearer role definition, a concern of 
educators, schools, and communities for decadet^ (Massanari, 1973). It may 
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also help schools meet new and coerging requirements, such as the need 
for Job definition as a part of affirmative action programs (U.S, Equal 
Employment Opportunity Cofiftlssion, 1974). 

Input from the field provides a means of settling another dispute: 
that of setting priorities is among possible competencies to be included 
in the training program. Thomas and Kay (1974) note the need to determine 
priorities based upon practical constraints. Any educational preparation 
program can only focus on a small portion of all possible knowledge and 
skills. SEATP has attempted to identify a core of minimum essential compe- 
tencies without which a person could not function in the position of 
director of special education. In addition to resource constraints, and 
the agreement of various means of competency identification, it has been 
considered essential to focus upon these minimum competencies simply 
because new special education directors do not have them* The emphasis 
on minimum essential coi^tancles should not be regarded, however, ^as 
merely an accommodation to existing condition; it carries with it some 
strong intrinsic program development advantages. Popham (1973) points 
out that: 

It is easier to Improve a low density program (one that 
concentrates upon minimum competencies) by supplementing it 
than it is to delete segments of a high density program, for 
\ in the latter approach we may be excising the- very ingredients 
that contributed to whatever effectiveness the program 
possessed, ^p. 5) 

Thus emphasis on minimum essential competencies helps to promote the 
program modification provisions which are central to SEATP. 

Assessment . Questions about assessment are inherent In concerns 
about appropriateness of a competency-based approach and methods of 
competency identification and selection. However, another area of concern 
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Is the appropriateness of the measures used to evaluate whether or not a 
teacher has attained the specified competencies • Since "performance" is 
a defining characteristic of education, and if some type of performance 
assessment is used to evaluate instructional competency-based outcomes, 
this type of criticism would appear to be circular (rejection of the 
concept of competency-based training itself), or reassertion of the 
impossibility of specifying the correct competencies. However, given a 
more favorable construction, such comments could suggest a need to measure 
long-term retention or maintenance of adequate performance, which can 
easily be incorporated into the SEATP model. 

SEATP has placed primary reliance on performance ratings as a means 
of assessment, both directly (simulated assessment of on-the-job peformance) 
and indirectly (domain-referenced testing in ar^s of knowledge related 
to areas of essential job performance). Correlation of domain-referenced 
test results with performance ratings is used to evaluate the extent to 
which cognitive instruction influences job performance. 

The domain-referenced test procedure is au approximation to direct 
measurement of competencies in cognitive areas. Statistical procedures 
(described in the section on program development) are used to infer the 
extent to which the test used for an individual measures his grasp of 
information, concepts, and their application in the domain being measured. 
Purpose of preparation programs 

Product validation of competency-based programs . One of the most 
difficult areas of controversy for competency-based education to resolve 
is that of the ultimate means of evaluating or validating the training ( 
program* Must its criterion of effectiveness be the pupil changes brought 
about? 
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Some vrriters, such as Rosner and Kay (1974), consider evaluation of 
competencies against pupil outcomes to be mandatory. They posit a four- 
part structure for development of a competency-based program: tentative 
competency Identification, focused training for those competencies, assess- 
ment'' of degree of mastery, and validation of competencies against pupil 
outcomes. In a similar vein. Maxwell (1974) asserts 

If what the student is asked to do is not shown to 
affect his teaching effectiveness, it has no valid claim 
for inclusion in a performance-based program, (emphasis 
in the original) (p. 307) 

and terms competency-based programs not validated by pupil outcome as 

"illegitimate." Others consider teacher performance to be primary; relevant 

knowledge should be taken into account, and evidence of pupil behavior 

should be used where valid and feasible. Elam (1972), for example, notee ' 

that PBTE stipulates a focus on peiformance and does not discuss pupil 

outcomes . 

Weber (1974) discusses the issue in terms of three types of criteria 
which have been used by numerous writers for studying teacher affectiveness: 
(1) presage variables such as personality and knowledge, (2) process or 
performance variables, such as teacher /student interaction behavior, and 
(3) product variables, or changes in student behavior. The latter criterion 
is the most rigorous of the three. 

SEATP uses the knowledge and performance specifications developed 
through the competency identification process as internal evaluation 
criteria. At present, external validation in terms of effects on performance 
of handicapped pupils or other Impact on special education profjrams because 
the type of product or program change which might be expected is difficult 
or impossible to specify. There is some evidence suggesting that presence 
of a special education administrator is associated with availability of 
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services for handicapped children (Prazich, 1972), but the study did not 
attempt to determine whether the administrator was responsible for those 
changes, or whether conditions which led school districts to employ & 
director also were responsible for increased allocations for direct 
services. 

Effectiveness studies using Weber's criteria would also be difficult 
to conduct due to the situation-specific nature of some factors affecting 
performance and product evaluation. On the basis of available information 
regarding director of special education role and function, one would expect 



to find that knowledge and personality factors might be fairly consistent 
among effective directors, performance might be somewhat consistent • but 
product variables among effective directors would very likely be divergent. 

The expected type of consequence or product of effective teacher 
behavior is changes in pupil behavior, although Elam (I97i) notes that one 
of the difficulties in securing agreement on evidence of adequate teacher 
performance is that answers are situation-specific. With special education 
directors even the type of product which could be expected as an outcome 
may be situation-specific. It is to be expected that consequences might 
be invluenced by (1) differential service delivery system responsibilities . 
of special education administrators and (2) administrative role functions. 
Some of this diversity is idiosyncratic to individual school S'/stems and 
their policies and procedures. Others might systematically vary among 
school systems in urban, rural and suburban areas, between single and 



multiple district programs, and by the size of the district. The complexity 
of situations suggests that product evaluation of special education adminis- 
trators in terms of special education program outcomes would not be 
useful at this tire. 
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Education for leadership * Related to the difficulty in specifying 
the products to be expected as a result of special education administrator 
training is the press for leadership training of such personnel* The 
Council for Exceptional Children's professional standards committee (Geer, 
1966), for example, stipulated that an administrator or supervisor 
exhibit that "quality of leadership which implies creative effort as well 
as efficient performance of routine duties" (p* 442). A similar distinction 
is the ability of an administrator to anticipate future needs and develop 
actions accordingly, as opposed to maintenance of the status quo * 

Competency-based programs, based upon examination of existing positions 
and preparing persons to function in those positions, can be charged with 
ignoring the need for leadership in the field, and making few attejnpts to 
provide e^lucation to encourage those who move beyond adequate performance 
on the job* 

Requests for training leadership personnel rest on the assumption 
that "leadership" in a special education administration position can be 
operationally defined, which in turn implies that the tasks to be accomplished 
are known* However, it has been previously indicated that the direct orb 
job is vague and varies with the situation* "Leadership" proba|)ly varies 
accordingly. It is recognized that special education directors operate 
in ecology. Many factors determine a resp'^nse in a given situation, 

\ 

and many of them are unique, \ 

The SEATP emphasis on minimum essential competencies, recognizing 
the diversity in job situations, ic an attempt to respond to established 
widespread tialning needs without attempting to forecast needs in each 
position* 
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Thus, in addition to difficulties in specifying expected products 
attributable to an effective director of special education, it is often 
difficult to assess appropriate performance beyond those tasks which are 
required of all directors. The extent to which further specification of 
leadership behavior can be made is a legitlnnte subject for research, and ^ 
the competency identification and assessment data collected as an ongoing 
part of SEATP operations might well provide a base for such research. 
Conclusion 

SEATP has been developed as an attempt to meet critical continuing 
education needs of special education administrators. At this point the 
program and model are still regarded as tentative and subject to revision 
from experience. While it is recognized that a new system with some 
differing requirements might cau3e some discomfort or disequilibrium in 
those trained by other methods, SEATP planners believe that both the 
methodology and procedure used in the program are defensible. 

The SEAT? approach gains additional credence from consideration of 
the alternatives. Inability to specify anJ justify competencies appears 
fraught with danger as court decisions and legislative pressures regarding 
accountability of programs to educate are added to other general concerns 
of citizens for education as it is now structured. 
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